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"CLOSED  NETWORKS  OF  QUEUES" 

ABSTRACT 

RICHARD  J.  SWERSEY 

A  closed  network  of  queues  consists  of  a  finite  set  of  J7  customers,  a 
finite  set  of  M  single-channel  servers,  and  a  set  of  arcs  (i,j)  which  rep¬ 
resent  the  allowed  instantaneous  movement  from  station  i  to  station  j.  We 
also  assume  that  all  customers  are  identical  in  their  stochastic  behavior, 
that  movement  is  governed  by  a  set  of  given  transition  probabilities  such 
that  they  form  an  irreducible  Markov  chain,  that  service  times  are  governed 
by  an  exponential  distribution,  and  that  the  imbedded  Markov  chain  defined 
on  the  instants  of  service  completions  is  irreducible. 

Under  these  assumptions  steady-state  operating  characteristics  are 
derived  through  analyses  of  the  time-average  steady-state  equations  and 
of  the  underlying  Markov  chain.  The  general  results  are  specialized  to 
cyclic  queues  and  to  open  networks  of  queues  (jobshop-like  queuing  sys¬ 
tems);  the  structure  of  the  steady-state  probabilities  is  the  same  as  that 
of  the  cyclic  queue.  r  We  also  show  that  the  results  can  be  generalized  to 
a  multi-channel  server  problem  and  that  the  number  of  customers  at  a  given 
service  center  has  an  IFR  (increasing  failure  rate)  distribution. 

Optimal  allocation  of  labor  (servers)  from  a  fixed  pool  is  considered 
and  it  is  shown  that,  in  a  cyclic  queue,  maximum  output  is  achieved  from 
an  equal  allocation  of  labor  to  each  service  center.  A  discrete  optimiza¬ 
tion  problem  is  then  considered  for  a  more  general  network  that  represents 
the  operation  of  an  airlines  maintenance  base.  I 


Chapter  I 
INTRODUCTION 


1.  Queuing  Networks 

Consider  tha  operation  of  a  haulage  system  in  a  coal  mine.  Shuttle 
cars  are  loaded  at  various  working  faces  and  travel  to  a  common  unloading 
point  at  a  bait  conveyor.  The  shuttle  car,  thus,  is  served  at  two  sta- 
•  tions— a  randomly  selected  working  face  where  it  waits  if  and  only  if  an¬ 
other  car  in  its  loop  is  being  loaded,  and  the  unloading  point  where  cars 
from  several  loops  may  queue  up  to  be  served.  This  is  a  special  case  of  a 
queuing  network— it  is  cyclic  for  a  given  car  because  the  same  operations 
are  repeated  continually,  but  has  a  more  general  network  character  because 
a  randomly-chosen  car  unloaded  at  the  conveyor  may  return  to  one  of 
several  faces. 

A  more  complex  structure  is  represented  by  the  overhaul  and  mainte¬ 
nance  base  of  an  airline  system.  Here,  an  item  is  probably  inspected  for 
unseen  difficulties,  as  well  as  undergoing  routine  maintenance,  and  hence 
may  go  through  various  movements  in  the  system  before  it  returns  to  ser¬ 
vice.  We  have,  in  effect,  a  closed  loop  system  with  various  internal 
series-parallel  movements,  and  congestion  at  every  station  within  the  sys¬ 
tem. 

These  two  examples  have  the  following  things  in  common: 

(1)  The  number  of  served  units  and  service  stations  is  fixed,  i.e., 
the  system  is  closed  (where  in  the  second  example  the  airplane 
In  service  is  part  of  the  system) . 
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(2)  The  possible  internal  movements  from  station  to  station  provide 
a  well-defined  network « 

(3)  Variability  of  service  times  creates  congestion  in  the  form  of 
random  queues  in  front  of  each  service  station. 

For  these  reasons  we  shall  refer  to  the  models  developed  in  this  thesis  as 
closed  networks  of  queues.  We  shall  determine  their  operating  characteris¬ 
tics  under  assumptions  specified  below,  and  we  will  contrast  their  behavior 
with  other  models  which  have  been  analyzed  in  the  literature  -  cyclic 
queues .  and  open  networks  of  queues  (jobshop-like  queuing  systems) 

2.  Analytic  Framework 

We  define  a  closed  queuing  network  as  consisting  of 

(1)  a  finite  set  of  h  .ustO'ers  (serviced  units  such  as  airplane, 
shuttle  cars,  machines) 

(2)  a  finite  set  of  M  single  channel  servers  (service  stations  such 
as  machines,  repairmen,  etc.) 

(3)  a  set  of  arcs  (i,j)  which  represent  the  allowed  (Instantaneous) 
movement  from  station  i  to  station  j. 

We  will  also  make  the  following  asstr.ptions: 

(1)  All  customers  i  «1,  2,...N  are  identical  units  in  terms  of  their 
stochastic  behavior  in  movement  ove.*  the  network,  and  in  selec¬ 
tion  of  a  service  time  at  some  station  j  -  1,...M. 

(2)  Movement  over  the  network  is  governed  by  a  set  of  given  transi¬ 
tion  probabilities,  p^j. 

?lj  “  ?  C  customer  moves  to  statloc[  j  [  he  has  just  completed 
service  at  station  i  ] 

We  assume  that  Zfgj  ■  1,  and  the  associated  Markov  chain  is 


irreducible 
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(3)  The  service  time  distribution  F(t;i,n)  at  station  i  is  the  sane 

for  all  customers,  possibly  dependent  on  the  total  numocr  of 

% 

customers  at  this  station,  n  -  1,2...N.  In  particular,  we 
assume: 


-Ht  (n)t 

F(t;i,n)  ■  1  -  e  t  -  0 


It  is  important  to  note  that  the  model  loses  the  Identity  of  individual 
customers,  and  this  is  not  suitable  for  special  items  which  have  unique 
paths  through  the  system.  For  an  analysis  of  a  class  of  such  problems  see 
SwerseyC  9  1  Apart  from  the  lost  identity  of  the  customers,  the  most 
critical  assumption  is  (3)  •  However,  eliminating  the  exponential  property 
yields  insurmountable  difficulties  because  it  is  impossible  to  define 
appropriate  Imbedding  points  which  lead  to  a  meaningful  analysis  and  to 
significant  results.  In  principle,  however,  one  can  extend  the  results  to 
the  Erlang  distributions  by  the  methor.  of  stages. 

3.  Optimization  Problems 

In  addition  to  steady-state  operating  characteristics,  we  are  also 
interested  in  system  economics.  For  example,  one  can  associate  a  cost  with 
the  time  a  customer  waits  in  queue  to  be  served  and  another  cost  with  the 
time  a  server  waits  for  a  customer.  If  one  is  given  a  specific  queuing  net¬ 
work,  it  is  of  interest  to  compute  the  trade-off  between  expected  costs  of 
customer  idle  time,  and  expected  costs  of  server  idle  time.  One  can  then 
decide  whether  to  buy  new  machines  to  decrease  service  times,  or  whether  to 
add  servers  or  customers  to  the  system.  Or,  if  the  queuing  network  repre¬ 
sents  a  production  cycle,  one  can  compare  the  marginal  value  of  extra  out¬ 
put  with  the  marginal  costs  of  obtaining  that  output.  And  so  on. 


Thus,  Che  objective  of  this  dissertation  is  twofold— to  develop  closed 
form  expressions  for  steady-state  probabilities,  expected  waiting  times, 
and  other  relevant  operating  characteristics  of  queuing  networks,  and  to 
analyze  some  optimal  operating  policies  on  some  special  structures  of 
these  models.  We  will  also  compare  these  models.  We  will  also  compare 
these  models  with  Koenigsberg's  [6]  cyclic  queues  and  Jackson's  [4,  5]  open 
networks  of  waiting  lines. 

4.  Definitions  and  Notation 

i  ■  index  of  a  service  center  (i  «*  1...M) 
fii  ■  exponential  service  rate  at  i  (independent  of  the  number  of 
customers) . 

n^  -  total  number  of  customers  at  i,  equal  to  those  waiting  for  service 
plus  the  one  in  service 


M 

S  n^  *  N 

i-1 

(n1,n2,...nM)  ■  state  vector:  nj^  customers  at  server  1, 
n2  at  server  2,  etc. 

yfi,  m  set  of  all  possible  arrangements  of  (n^.,.11^) 

(N+M-DJ  ^ 

A  »  card  -  '(ji-i)  j  (the  dimension  ofj^) 

a,b,...»  elements  of  \J\ 

a  ■  (^...i^j)  a  point  coordinate  of  interest 
a(i,j)  ■  the  neighboring  point  of  a, 

(n^  ,n2  •  •  .nj_+ 1, .  •  #  n  j — 1 ,  •  •  •  n^) 

P(a)  m  time  average  steady-state  probability  of  being  in  state  a. 
n^(a)  ■  number  of  customers  at  station  i  for  state  a. 
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v„rV.(«)  ■  set  of  all  possible  arrangements  of  such  that  property 

(•)  holds. 

A(*)  ■  cardcAd(») 

lC»]  ■  indicator  function  *  ProPerty  (•)  holds 

10  otherwise 

■  steady-state  average  rate  at  which  customers  pass  through  station  i. 

H 

11 "  i-i  Pj'1,j  1  ‘  1“'H 

where  Pj  ^  Is  defined  in  assumption  (2) ,  Chapter  I. 

Vl  -  M i/q 

■  y±ly\  ,  the  relative  mean  service  rate  at  i  with  respect  to 

server  1. 


Chapter  II 
CYCLIC  QUEUES 


1.  Introduction 

In  1958,  Koenlgsberg  published  the  first  [6  ]  of  two  [7  ]  articles  on 
cyclic  queues.  In  his  model,  M,  servers  are  linked  in  series  with  the  last 
one  in  a  closed  loop  with  the  first  one.  (  Figure  1  ) 


In  terms  of  the  more  general  network  model  this  is  a  special  case 
where, 

%(n)  ■  for  all  n-1, . .  .N(i-1.,  .M) 
p^  ■  1  i=l,...H(Mfl  is  defined  as  1) 

Pi, j  -  0  3  +  i+1 

and  defining  q^  ■  1  »  1  ^  ■  2...M 

and  hence  Yi  m  i  m  1*  • 
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In  this  chapter  we  will  discuss  his  results  and  cast  them  into  a  uni¬ 
fied  framework,  correcting  some  minor  errors.  Our  purpose  is  not  just  to 
illustrate  the  beginnings  of  research  on  queuing  systems;  in  later  chapters 
we  will  show  that  even  the  most  ccmnlicatad  network  structure  can  be  re¬ 
cast  so  that  the  results  have  the  same  form  as  Koenigsberg1  s  original 
model!  It  is  this  fact  alone  that  makes  analytical  optimization  of  net¬ 
works  of  queues  tractable.  (Chapter  V) 

2.  Steady-State  Equations 

Because  the  service  times  are  exponential,  we  can  immediately  write 
down  the  steady-state  equations  (after  Koenigsberg  [  6]  )  : 

M  ,  M 

Pta]  Z  y  iCn^la]  -  S  PCadji+D^lCi^^Udii+l)] 
i*l  1  i-1 

The  solutions  take  the  form, 

ii-r.i(a) 

y-i 

P(a)  -  P(N,0,....0)  - Z - - 

n  y^iCa) 

i-2 


or 

(2.1) 


and 


1 


s  “  Y  Va) 

Lj  u  Xj 

ae.fi  i-1 


M  iw:-i 
r. 


M  n,(u) 

(,-2)  Sk  Ah  -  ik-jr1 


a 

H 

Sh. 


Equation  (2.2)  has  been  specifically  evaluated  for  M  -  1,...5.  See  £6}  . 
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3.  Operating  Characteristics 

We  will  repeat  here  some  operating  characteristics  of  cyclic  queues. 
For  details  of  the  development,  see  [  6]  . 

Let  D.^  ■  P  Server  i  is  idle 

ZN 

Then  D<  -  1  (i  -  1...M) 

ZM 

where  indicates  that  is  omitted  from  the  summation  in  (2.2). 

Let  0^  the  average  number  of  customers  served  per  unit  times  at  sta¬ 
tion  i;  then. 


(2.3) 
and 
Let 

(2.4) 

and 


0  -0.»0  for  all  i  and  j. 

•  J 

E[L(i)]  ■  expected  number  of  customers  at  server  i.  Then 


E[L(i)]  - 


):i 


n  /. 
iUxt 

Sk 


ECl  (i)]  "  mean  number  of  customers  waiting  at  server  i 


(2.5) 


E[L(i)]  -  (1-D. )  . 


4.  Cyclic  Queues  and  Markov  Chains 

In  order  -  to  find  the  average  waiting-time  per  customer  at  each  server 
we  will  need  to  know  the  steady-state  probabilities  of  the  imbedded  Markov 
chain.  After  our  own  development  of  these  probabilities  we  can  correct 
Koenigsberg's  result  for  average  waiting-time. 

Because  of  assumptions  (3)  and  (4)  of  Chapter  I,  a  cyclic  queue  with 
exponentially  distributed  service  times  is  a  continuous  time  Markov  process 
with  a  discrete  state  space.  Since  the  customers  are  identical  (assumption 
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(1),  Chapter  I)  the  state  space  of  the  Markov  chain  imbedded  on  the  instants 
of  service  completions  at  any  service  center,  consists  of  all  arrangements, 
lA.  ,  and  its  dimensionality  is  A.  Number  all  possible  states  a,b  =  1,2. . .A 
and  let, 

ff(a,b)  «  Harkov  transition  probabilities  between  states 

(a)  and  (b)  on  the  instant  of  a  service  completion 
ff(a)  -  stationary  Markov  chain  probability  of  being  in  state  a. 


Theorem  II-l:  The  Markov  transition  probabilities  between  states  (arrange¬ 
ments)  a  and  b  (a,b  -  1,2... A)  are: 


(2.6) 


ir(a,b) 


/  M 

£  n-t  lCni(b)  -  nA&) 
i-1 

“M 

£  nt  lCni(a)>0] 
i-1 


1  ] 


if  a  to  b  is  possible 


\  0  otherwise 

Proof:  First  consider  the  special  case,  M  -  3  and  N  -  2.  The  transition 
matrix  is: 

(200)  (002)  (020)  (101)  (110)  (Cll) 


(200) 

(002) 

(020) 

O], 

(101) 

(no; 

(on) 

Consider  the  transition  (110)-*  (020)  and  call  this  event  G. 


0 

Q 

0 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

1 

“a 

0 

0 

0 

0 

h 

"1 

Yb 

0 

0 

“2 

0 

0 

^2 

V^2 

^3 

0 

0 

0 

0 

^3 

P(G)  -  P  [service  completion  at  Center  1  before  a  completion  at 
Center  2] 

-  ^  J  e  x  dt  - 


I 

'/ 
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since  the  only  other  competing  transition  is  (110)  -*  (101) ,  which  requires 
a  service  completion  at  Center  2.  The  general  result  (2.6)  follows 
directly  from  these  observations. 

The  formula  (2.6)  can  also  be  derived  from  Billingsley' s[ 2]  "intensity 
functions,"  where  we  interpret  a  term  in  the  numerator  as  the  intensity  of 
a  jump  into  the  state  it  represents,  and  the  denominator  as  the  intensity 
of  jumps  out  of  the  current  state. 

Theorem  TI-2;  The  fT(a,b)  of  (2.6)  are  transition  probabilities  of  a 
closed  recurrent  clasa  >f  states  and  furthermore  there  exists  a  unique  set 
of  stationary  probabilities  of  the  imbedded  Markov  chain  given  by  the  solu¬ 
tion  to 

(2.7)  ir(b)  -  E  ff(a)  *(a,b) 

ae*ft 

£  ff( a)  -  1  . 

Proof;  It  is  obviou3  that 

17(a,b)  *0  and 

E  ir(a,b)  *  1  for  allacJt 
bc/l 

Since  the  p^j  form  an  irreducible  Markov  chain,  all  service  centers  com-* 
municate.  That  is,  a  customer  can  move  from  any  center  i  to  any  center  j, 
with  non-zero  probability,  in  a  finite  number  of  steps  (<?•!), 

Now  states  a  and  b  differ  from  each  other  only  in  the  placement  of  a 
finite  number  (<  N)  of  customers.  By  moving  one  customer  at  a  time,  any 
state,  a,  can  be  changed  to  any  other  state,  b,  in  a  finite  number  of  steps 
(<  KM)  and  this  set  of  changes  occurs  with  non-zero  probability.  Hence, 

some  finite  power  of  [^(a,b)3  is  eventually  non-zero,  implying  all 
states  communicate;  communication  implies  that  all  states  of  the  chain  be¬ 
long  to  a  single  irreducible  class.  Furthermore,  since  at  least  one  state 
is  persistent  (A  is  finite)  the  chain  is  irreducible  ergodic. 

Theorem  II-3:  The  stationary  probabilities  of  the  associated  Markov  chain 
are  given  by; 

H  nt(b) 

n  x, 

ir(b)  -  ±=i _ _ _ 

M  n^b)  M  | 

E  n  Xt  E  ut  iCn.^Olb] 
be  A  i=l  i-i 


E  l[r  >o|b] 


(2.8) 
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and  furthermore  they  are  related  to  the  time-average  probabilities  by, 

M 

P(b)  l  ui  l[n±>0|b] 

(2.9)  TT(b) - ^ - 

l  P(b)  l  w.  I [n  >0 | b ] 
be*  i-1 

Proof :  Formula  (2.8)  is  obtained  after  much  tedious  manipulation  of  (2.7). 

We  know  that  the  ir(b)  are  asymptotically  equivalent  to  the  ratio: 

Expected  number  of  transitions  into  state  b 
Expected  number  of  transitions  in  the  system 

The  number  of  transitions  out  of  state  b  differs  by,  at  most,  one  from  the 

number  of  transitions  into  b  for  some  time  period  T  .  The  expected  number  of 

transitions  out  of  state  b  in  a  long  time  T  is, 

M 

P(b)  l  U  l[n.>0|b]  •  T 
i-1  1  1 

where  P(b)  is  a  time-average  probability,  and  the  total  number  of  transitions  in 
the  system  during  time  T  is 

M 

l  P(b)  l  1 [n . >0 | b]  •  T 
be*  i-1 

Hence,  as  T  -*■  00  ,  tt (b)  is  given  by  (2.9). 

Corollary  (II-3):  The  time-average  probabilities,  P(b)  ,  Theorem  II-3  are  given 
by  formula  (2.1). 


Proof :  From  an  examination  of  (2.8)  and  (2.9)  we  conclude  that 

M  n  (b) 

p(b)  -  c  n  x 

i-1 


where  C  is  a  constant. 
Let 

Then 


C  - 


1/Z 


N 

M 


M 


p(b)  -  i/zJJ  n  x 


n1(b) 


i-1 


which  is  (2.1). 
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From  equation  (2.8)  ve  can  derive  all  of  the  7(b)  and  use  them  to 
solve  for  the  P(b)  in  equations  (2.9).  No  claim  is  made  that  computing 
?(b)  from  the  7(b)  is  easier  than  using  equation  (2.1);  however,  if  we 
consider  a  system  that  is  a  variation  on  the  cyclic  queue  (see[  7])  the 
construction  of  the  state  space  and  solution  for  the  7(b)  might  prove  to 
be  an  easier  task  than  setting  up  the  balance  equations  and  solving  for  the 
?(b).  Koenigsberg’s  aporoach,  however,  yields  the  transient  solutions  if 
they  are  of  interest.  ...  ation  (2.9)  establishes  the  link  between  the 
theory  of  Markov  chains  and  the  time-oriented  queuing  formulation  for  cyclic 
congestion  systems. 

Equation  (2.8)  can  be  chang'd  to  a  less  cumbersome  form,  and  we  can  do 
some  cancellation: 

M  n:(b)  M 

n  ij  2 

(2.10)  7(b)  -  j»l _ i=l 

M  nj (b)  M  ! 

2  n  Zi  z  ^  i  [n*  >o  |b  3 

bfJl  i-1  i»l 

As  in  [6]  define 


H,  l[nt>o|b] 


N 

M  nt(b) 

(2.11) 

B  - 

2  n  Xi 

M 

b^St  i=l  : 

After  much  algebra 

one  obtains, 

N 

tui 

i 

V  2lIi 

2 

i«0 

*2 

N-l  3  <  N-2 

Bj  -  3^1 

1  + 

2  2  2.  1 3  +■  2 
J“1  k°2  n2*'1 

M 


l[nt>ofb3 


r  Vij’j 
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and  in  general,  (M  >  2)  (2.11)  becomes 


(2.12) 


BS  »  MU.  (1  +  S  L 
1  >1  k-2 


K-2  M  n 

♦  s  ....  s  n  x  J ) 

V1  V1  J"2  J 


Therefore,  an  alternate  form  for  (2.10)  is, 

N  M  n. (b)  K 

(2.13)  tr(b)  -  l/T  (  n  X.^  2  p.  l[n!>o|b] 

w  i=l  i-1 

We  will  use  (2.8)  directly  in  the  next  section  in  order  to  compute  the 
average  wait  at  each  server,  and  we  will  use  the  Markov  chain  analyst*  in  a 
later  section  on  statistical  inference. 

5.  Customer-average  Wait  in  Queue 

In  order  to  find  the  average  wait  in  queue  at  any  station  we  must  dis¬ 
tinguish  between  the  average  number  in  a  queue,  at  an  arbitrary  instant  of 
time  and  the  average  number  found  by  an  arbitrary  arrival. 

Define  the  random  variables, 

R(i)  ■  total  number  of  customers  at  server  i  just  after 
some  arrival, 

Rq(i)  »  number  of  customers  in  queue  at  server  i  just  after  some 
arrival, 

^•(n^l)  -  set  of  all  possible  arrangements  of  (n^...,!^)  for  which 


n>l  for  some  service  center  i 


]k 

Define: 


ff^(b)  ■  P  [system  in  state  b  after  the  next  arrival  at  station  i] 


T?,t  (b)  »  F  [system  in  state  b  after  the  next  transition  [next  transi¬ 
tion  is  an  arrival  to  station  i] 


Theorem  II-4: 


(2.14)  TT^b)  - 


where 


M  nt(b) 

^  nut  n  x:, 

i°l  1 

hi 


\  0 


il  ttt(b)ai 


otherwise 


1  S  ff(b(i-l,i))  i 

M  bcA^n^l) 

(2.15)  - i _ 

M 

£  Hi  l[nt>0|b(i-l,l)3 

i-1 

Proof: 

From  the  definition  of  TT^  (b) , 

ff|(b)  -  ir(b(i-l,i))  V-i-i/  ^  l[nt>o!b(i-l,i)3 

i-1 

Plnext  transition  is  an  arrival  to  iJ 
We  have  already  seen  that  in  the  steady  state  all  service  centers  do  the 

same  amount  of  work;  that  is,  they  all  have  the  same  average  transition 

rate  0  .  Therefore, 


P  [next  transition  is  an  arrival  to  i]  ■  ^  » 

which  by  definition,  is  given  by  (2.15).  We  note  that  7^)  is  a  proper 
probability  sequence  over  for  all  i  . 


Corollary  (II-4) : 


(2.16) 


Knt 

E[Ri]- 


M  n^b) 

e  n  xT1 

bcJUn^l)  i-1 
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Proof:  Trivially  shown  by  the  definition  of  the  expected  value  and  the  use 


of  (2.14). 

We  can  also  express  (2.16)  in  a  form  similar  to  (2.5)  by  defining: 

Define: 

■  number  of  customers  at  i  after  the  next  transition  in  the 
system 

Then, 

E(Rj)  ■  1  +  mean  number  of  customers  at  i  (except  arrivals  at  i  ), 
averaged  over  all  transitions. 

Recall  that  the  probability  a  transition  is  an  arrival  at  1  is  just 
Then  the  mean  number  at  i  (except  arrivals)  averaged  over  all  transitions  is 
just, 

eCq^)  when  the  transition  is  not  an  arrival  at  1 
E(Q±)  -  1  when  an  arrival  at  1  occurs. 


Thus,  E(R  )  -  1  +  EtCL)  (l-l)  +  (S^)-!)  1  1  -  1...M 

1  Fi  M 


(2.16a)  E(Rj)  -  E(Qj)  +  1-1 

M 


Noting,  that 


11 

-1  s  rL(b)  n  L 

Pi  b€  x  k-1  K 


nk(b) 


E 

b€ JKn.il) 


K 

E  nx 

i-1 

l 

k-1  ^ 


lCn^>o|b] 


(i-2, . ,M) 


E(Qi)  -  -  C^Bj^Pt)  Pj 


+  i 

M 


we  find 


Hja 
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Thus,  an  alternate  form  for  (2.16)  is: 
(2.16b) 


I»,  *  l 


4 


By  similar  arguments. 


(2.i6b)  e^)  -  -(aBj/y^)  m  +  n  + 1 

Define:  H 

W(i)  ■  time  spent  at  server  i  by  a  customer 


Wq (1)  ■  queuing  time  at  server  i  by  a  customer 


Then, 


E(W(i))  ■  E0E(W(i)  jn^  at  i  after  last  arrival)] 
-  E(  n^t  )  -  l/n,  Efi^) 


But  n^  -  Rj,  so: 

M  M  n.  (b) 

(2.17)  E(W(i))  -  E(R,)/nt  -  _  E  a,  n  \ 

N  bCvPJn^l)  i-1 

% 

and 

(2.17a)  E(W  (i))  -  E(W(i))  -  I 

We  would  like  to  correct  here  a  result  of  Koenigsberg's  [6]  (formulas 
(17) ,  (18) ,  p.  28) .  He  claims  that  the  mean  wait  in  queue  is  Just 

E(Lq(i))/pr 


where  E  (Lq (i))  is  Che  time  average  number  in  the  queue;  but  this  result 
would  be  correct  only  if  che  arrival  stream  at  each  service  center  was 
Poisson. 

For  the  special  case  where  all  the  service  centers  have  the  same  rate, 
1  say, 


E(W  (i))  -  N-l 
K 

and  Koenigsberg  gives  E(Wn(i))  -  N(N-l) 


A  comparison  of  this  discrepancy  for  various  values  of  N  is  given  below: 
CM=3) 


N  E(Wq(i))  E  (Wq  (Koenigsberg)  ) 


3  .667  .4 

4  1  .667 

10  3  2.5 

100  33  32.3 

1000  333  332 


Koenigsberg' s  formula  understates  the  mean  wait  in  queue  and  its  use  might 
cause  difficulties  in  analyzing  a  real  world  situation.  However,  we  wil) 
show  later  that  as  the  number  of  customers  in  the  system  gets  very  large, 
that  (2.12a)  approaches  Koenigsberg' s  result.  His  other  major  results, 
formulas  (2.1)  -  (2.6),  here,  are  stated  correctly  in[6J.  One  other  operat¬ 
ing  characteristic  will  be  useful  in  Chapter  IV, 

Define: 

T  -  time  for  an  arbitrary  customer  to  complete  one  cycle  of 
the  service  systems. 

H 

T^en,  T  -  E  W(i) 
i-1 


(2.18) 


E(T) 


i  E(W(i)) 

i-1 
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6.  Statistical  Inference 


The  previous  sections  all  dealt  with  a  system  for  which  the  service 
rates  were  known;  however,  in  many  real-world  situations,  the  service  rates 
are  unknown.  One  method  of  estimating  these  rates  would  be  to  observe  the 
system  and  note  the  transitions  that  actually  occurred  and  the  length  of 
time  between  transitions.  From  methods  developed  by  Billingsley  [2]  we 
could  then  estimate  the  service  rates  and  test  hypotheses  concerning  these 
estimates. 

The  method  used  here  (see  Swersey  [9])  parallels  the  development  by 
Wolff  [lO]  for  birth  and  death  processes. 

If  the  system  is  observed  continuously  for  a  fix^ri  time  T,  a  sequence 
of  S  (where  S  is  a  random  variable)  transitions  will  be  observed.  We  can 
then  estimate  the  service  rates  by  the  maximum  likelihood  method.  Denote 
the  likelihood  function  for  the  observed  sequence  by  Lg(j5)  where  0- 

Let, 

Ugi  «  a/a$  In  LS(G) 

Ha  "  (Us1»US2'*"USm) 

We  are  interested  in  the  asymptotic  properties  of  the  function  Ug  and  of 
the  maximum  likelihood  estimators,  0,  obtained  by  setting.  Ug  *  0. 


As  T  — *  •  ,  S  •*  •  a.s. 


As  T  “  ® 


(2.i9)  IL  -  N(O,c(0)) 

7s 

where  cr(0)  is  the  variance-covariance  matrix  of  $  .  Also, 


(2.20) 
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The  proofs  for  (£.19)  and  (2.20)  are  given  by  Billingsley  fc  ]  . 

Moreover,  if  we  assume  that 

H  :  fl  -  6° 
o  ~  ~ 

and  Hq  Is  true,  then 


(2.21)  2&lax  In  La(9)  -  In  Ls(6°)l  -  >£ 
6 


A  statistical  inference  analysis  of  cyclic  queues  follows;  nota,  however, 
that  we  are  making  statements  only  about  asymptotic  properties  of  esti¬ 
mators  . 

Let  q(n,a,b)  -  likelihood  due  to  the  n  transition,  where  the  system  moved 
from  state  a  to  state  b. 

t  (n,a,b)  ■  time  spent  in  state  a  on  transition  n  ■ 

Assuming  exponential  service  times,  it  is  easily  shown  that  the  density 
function  of  T  (n,a,b)  is  given  by 


M 

(2.22)  f(T(n,a,b)  -  £  n,  I  CnWa)^] 

i-1 


r  K 

exp  [_  -r(n,a,b)  £ 
i-1 

where  the  indicator  function  now  depends  on  n 
for  the  nfck  transition  is  obtained  from  (2.4) 


The  transition  probability 


(2.23) 


*(n,a,b) 


M 

S  pt  I^Cn^-Cb)  -  n^a) 

i£l 


M 

Jl  1,1  InCni(*)>0] 


1] 


I 
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Then  <£n,a,b)  Is  just  the  product  of  (2.22)  and  (2.23). 

M 

<p(n,a,b)  -Em  jLCn^b)  -  &j(a)-a] 
i-1 

r  M 

-T(n,a,b)  E  m  I  [nj(a)>o] 
i-1 


We  as  turned  S  transitions  occurred  in  time  T.  The  probability  that  the 
(S+l)ft  transition  occurred  after  T  is  (tg  <T) 

M 

p[Ts+i>t-ts]  -  eacp[  -(t-ts)  £  m  lsln±(&)>0'] 

i-1 


Assume,  also,  that  a  stationary  distribution  in  time  exists.  Then  the 
observations  start  when  the  system  is  in  state  P(0),  say.  The  likeli¬ 
hood  function  is  asymptotically  equivalent  to 

M  S 

Lg(0)  -  P(0)eoq>[-(t-ts)  2  m  IgCn^a)^]]!!  cc(n,a,b) 


or  more  conveniently, 


11  S 

In  LgCO)  -  la  P(0)-(t-tg)  £  m  ^(^(a)^]  ♦  S  in  <p(n,a,b) 

i-1  n-1 


In  large  sample  theory,  the  starting  conditions  can  be  neglected. 


M  S 

In  Lg(0)  *  ~("t— tg)  £  M>i  lg[n^(a)>0]  +  £  In  <,o(n,a#b) 


i-1 


n=l 


and  ignoring  end  effects,  we  get 


S  M 

In  Lg(9)  -  £  In  £  T^[n,(b)  =  n^Ca)  -  l] 

n»l  i-1  “ 


S  M 

-  £  T(n<a,b)  £  ^  I  Cn.(a)>0] 


n-1 


i-1 


n  x 


In  order  to  estimate  the  M  parameters,  ^  ,  it  will  be  convenient  to 
redefine  the  summation  indices. 

Let  d£  -  vhe  number  of  times  during  T  that  the  completion  was  at 
stage  i. 


£  I  in.(b)  -  nj(a)  -  l] 
i-l  n  1 


Then, 


S  M 

£  In  £  M-j  I  [^(b)  -  n^Ca)  -  l] 
n-1  i-1 


M 

£  d.  In  ut  . 
i-1  1 


Let  yi  -  the  amount  of  time  during  T  that  n^(a)  >  0 
S 

-  £  T(n,a,b)  j^GbCa)^] 
n-1 
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Then, 

S  II  M 

£  T(n,a,b)  £  lCnt>o|a]  -  £ 

n-1  i=l  i«l 


and 


M  M 

In  L  (u)  -  £  dt  In  lit  -  £  yt  nt 
s  i-1  i-1 


$ln  L  (j±)/dp.t  -  0  ,  then 

o 

dt/n*  -  Vi  =  0 


and  the  maximum  likelihood  estimator  of  ^  is, 

■  dt/yj 


In  order  to  obtain  the  variance-covariance  matrix,  we  use  a  procedure 
of  conditioning  on  a  particular  transition,  then  on  the  state,  and 
finally  removing  the  conditioning. 


Let 

G(|ij )  -  In 

M 
*  • 

In  ^(n,a,b)  -  In  £  |At  I^CnjCb)  =  ni(a)-l] 
i*l 


II 

-  T(n,a,b)  £  ^[nj^la] 
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Consider  a  particular  station  i,  sa>. 


,  v  f'1/?1  “  T(nia»b) 

G(Hi)  -  {  -T(n,a,b) 

0 


if  nt  b  -  at  |a  -  1 
if  nt  a^O 
otherwise 


0 


In  <,o(n,a,b) 


if  i-j  and  nt  |b 


nt  |a  -1 


otherwise 


Then,  under  suitable  regularity  conditions  on  p(n,a,b)  (See  Billingsley 
[2]  for  conditions  on  interchanging  order  of  integration  and  differenti¬ 
ation) 


V(  GCHt)  |n,a,nt>0|a  )  -  -  E(  GCiij^jf^a^jiola  ) 


-  i-2 - 

H 

2  Hi  LCrn^la] 
i-1 

M 

-  IAh  2^  m  Ijitni^Ola] 


Also, 

7(  G(n,)  )  -  E(  V(G(u, )  |a  )  )  -  2  V(G(ut)|a)  *(a) 

a-1 


2 

ad^Cn^l) 


”(*) _ 

K 

^  2  ^  iCn^l*] 

i-1 


Substituting  (2.9)  for  17(a) 


Ih 


S  P(a) 

(2.24)  Y(G(^))  -  aC^-G^L) 

A  K 

|ij  E  P(a)  E  fx.  lCnj>oi&] 
a-1  i-1 

We  have  already  defined  (1-Dj)  as  the  fraction  of  time  the  l***1  stage  Is 
working;  the  numerator  of  (2.24)  Is  precisely  (1-Dj) .  If  we  expand 
terms  In  the  denominator  we  have, 

V(  G(^)  )  -  1-Di 

P-i  MR 

where  R  ■  (l-D^)U^  Is  the  output  of  the  system  and  is  the  same  for  each 
stage  1.  Then, 

V(  G(Hj)  )  -  1/Mu,2  =*  o(fl) 

Is  a  diagonal  matrix. 

We  are  interested  in  the  inverse  of  ff(6), 

(2.24.)  7aW/S(‘‘I  ‘  *  ilU;2 

Note  also  that  the  asymptotic  variance  has  a  slightly  different 
form  if  we  normalize  on  T  instead  of  on  S.  The  change  is  equivalent 
to  multiplying  (2.9)  by  the  limiting  form  of  T/S  which  is  clearly 
(1-Di)*  The  variance  becomes 

-  n))  -  h/tt-Di) 


(2.24b) 
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Now  the  dependence  on  the  time  average  probabilities  appears  formally. 
In  order  to  test  hypotheses  on  the  |Xt  ,  we  make  use  of  equation  (2.21) 
Noting  that  the  maximum  over  £  of  the  likelihood  function  is  obtained 
when  we  substitute  the  maximum  likelihood  estimators,  the  test  that, 

is  given  by 

r  M  M  X  o 

2  Ji  ^  ^  *  Ji  V.  - s] 


We  can  define  an  appropriate  constant  for  any  level  of  significance  and 
check  that  the  test  quantity  does  not  exceed  the  constant. 

In  particular,  we  might  want  to  test  the  nested  hypothesis  that  all 
of  the  (Jt  are  equal.  The  likelihood  equation  reduces  to, 

M 

In  Ls(ji)  -  Slnti-pS  y 

i*l 


H 

and  «  S/  E  y. 

i-1 


The  appropriate  test  quantity  becomes, 

M  K  X  ? 

2[  E  In  (di/y±)  -  S  ln(S/  E  y±)  ]  - 
i-1  i=l 
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7.  Customer-Dependent  Service  Rates 


The  probability  structure  of  the  cyclic  queue  model  can  easily  be  ex¬ 
tended  to  the  more  general  model  in  which  the  service  rates  are  occupancy- 
dependent;  i.e.: 

-4t  (n)t 

F(t;i,n)  -  1  -  e 

For  example,  in  certain  production  systems  it  is  possible  that  the  service 
rate  varies  as  the  number  of  customers  gets  larger  or  smaller  at  each  sta¬ 
tion:  the  steady-state  probabilities  turn  out  to  have  a  similar  form  to 
(2.1). 

Theorem  II-5:  For  a  cyclic  queue  with  customer-dependent  service  rates,  the 
steady-state  probabilities  arc  given  by. 


N-nWa) 

(2.25)  P(a)  -  P(N,0,....0)  n  u,  (IJ-k+l) 

k*l 

(k) 


K 

7T 


n 

i=2  k-*l 

where  a  product  is  interpreted  as  unity  if  the  upper  limit  is  rero. 


Proof:  The  steady  state  equations  are  given  by. 


M  It 

P(a)  £  P-t(ni(a))  l[ni>o|a]»  £  (a)+l)r(a(W.,i))lt1>o|a(iJ.,i)] 

i-1  i-1 


From  (2.25), 

II-iv,  (a) 

P(a(i-l,i))  -  P(N,0,...0)  H  MN-k+l) 

_  k«l _ _ _ 

H  nA&)  xuV(a}-T  5i(a)-l 

n  n  ti.(k)  a  n.  ,(k)ir  Mk) 

J-2  k-1  J  k-1  1-1  k-1 

J^i-1 

N-nx(a) 

-  P(N,0,...0)  n  ^(N-lc+1)  ^(^(a)) 

"M  njTa)  " 

n  ri  P’j(k) 

j-2  k=l 


P(a(i-l,i)) 
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Therefore  the  right  hand  side  reduces  to 


£  ^CnjCaJJlCn^la]  P(a) 

i-1 

by  assuming  (2.25)  is  true. 


Unfortunately,  no  further  reduction  of  (2.25)  is  possible  for  further 
analysis  of  operating  parameters.  Particular  problems  of  interest,  how¬ 
ever,  shall  be  handled  directly. 

For  example,  the  multiple  server  problem  can  be  analyzed  directly 
using  (2.25). 

t  kMi  if  1  <  k  <  Sj 

Let  P-j(k)  «l  SiUj  if  k>  St 


where  is  the  number  of  parallel  channels  at  service  center  1.  As  a 
special  case  let  S,  ■  S,  Sj^  ■  1  (i  +  j) .  The  steady-state  probabilities 
reduce  to, 


n.  (a) 

P(N,0,,..0)  n  Ik  A 

k-1 _  if  nA&)  <  S 

ni  i 

(2.26)  P(&)  -  J  * 

M  n,,(a) 

p(n,o,...o)  n  x, 

k=l  ‘  if  n,(a)  *  S 

- J^aPT  3 

S»  S  J 

8 .  Conclusions 


We  have  stated  Koenigsberg* s  key  results  for  cyclic  queues,  and  have 


indicated  some  extensions  through  analysis  of  the  related  Markov  process. 
With  these  fundamentals  as  the  base,  we  will  next  investigate  more  gen¬ 


eral  queuing  networks,  and  show  that  the  structure  of  the  state  probabili¬ 
ties  is  similar  to  that  of  the  simple  cycle.  Then,  the  results  derived 


here  will  be  used  to  analyze  these  more  general  structures. 


Chapter  III 

GENERAL  NETWORKS  OF  QUEUES 


1.  Introduction 

We  now  investigate  general  closed  networks  of  queues.  The  relationship 
between  these  networks  and  Koenigsberg's  cyclic  queue  model  will  be  further 
developed  and  we  will  compare  our  system  to  the  so-called  Jobshop  system  of 
Jackson  [4]  and  [5]. 

2.  Jobshop  Systems 

Jackson  [4]  and  [5]  has  described  what  he  calls  a  lobshop-llke  queuing 
system.  Such  a  system  is  defined  as  obeying  assumptions  (1)  -  (3)  of  Chap¬ 
ter  1  (where  N  ■  •)  plus  the  following: 

(4)  customers  from  outside  the  system  arrive  at  server  i  in  a  Poisson 
process  with  parameter  $1 

(5)  once  served  in  department  i  ,  a  customer  goes  to  department  j 
with  probability  p^j  ;  he  leaves  the  system  with  probability 

»-  *  * 

i-1  3 

Obviously,  these  assumptions  mean  that  the  probabilities  of  movements  of 

a  given  customer  are  independent  of  his  previous  history.  As  Wolff  [11] 

« 

has  pointed  out,  this  is  precisely  not  a  jobshop  model,  as  it  allows 
customer  to  cycle  in  the  system  forever  without  ever  leaving  it.  In  a  typi¬ 
cal  jobshop,  if  an  item  returns  to  a  machine  for  re-working,  there  is  a 
strong  likelihood  that  either  the  service  time  distribution  is  different 
than  on  Its  first  pass,  or  the  movement  probabilities  are  changed  or  both. 
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Instead  we  will  refer  to  Jackson's  system  as  an  open  network  of  queues 


Kis  results  give  insight  into  the  closed  or  cyclic  queuing  networks,  and 
they  are  also  useful  in  the  analysis  of  appropriate  systems. 

Jackson's  main  result  is  as  follows: 

Define: 

(3.0)  \  '  "o'  (r‘M)  1  “l"1""* 

where  -  p[  Server  i  is  idle  ]  and 

M 

rt  ■  pj  +  S  p.  I?  =  average  arrival 

k-1  **  * 

rate  of  customers  to  server  i  from  any  source.  Then,  (iff  <  jij  ) 

(3.1)  PCnp....^)  -  PniPn2 . Pifc 

Equation  (3.1)  is  a  powerful  result.  The  steady-state  probabilities  can  be 
treated  as  though  each  service  center  were  independent.  The  result  is  simi¬ 
lar  in  form  to  that  for  queues  in  tandem. 

Based  on  equation  (3.1),  we  might  expect  that  for  the  cyclic  queuing 
network  the  steady-stat"  probabilities  take  a  form  similar  to  the  series 
cyclic  queuing  formula  (2.1).  Jackson  [4]  has  extended  his  model  to  in¬ 
clude  the  cases  where  the  service  rates  depend  upon  the  number  present;  how¬ 
ever,  he  has  not  eliminated  the  assumptions  that  belie  the  jobshop  descrip¬ 
tion.  He  will  now  define  such  a  system  in  detail  and  prove  that  our 
intuitive  feeling  is  correct. 

3.  Closed  Queuing  Networks 

A  closed  queuing  network  was  defined  in  Chapter  I.  We  will  repeat  it 
here  for  clarity. 


/ 
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We  define  a  clued  queuing  network  as  consisting  of 

(1)  a  finite  set  of  N  customers  (serviced  units  such  as  airplane, 
shuttle  cars,  machines) 

(2)  a  finite  set  of  M  single  channel  servers  (service  stations  such 
as  machines,  repairmen,  etc.) 

(3)  a  set  of  arcs  (i,j)  which  represent  the  allowed  (instantaneous) 
movement  from  station  i  to  station  j. 

We  will  also  make  the  following  assumptions: 

(1)  All  customers  i  ■  1,2,...N  are  identical  units  in  terms  of  their 
stochastic  behavior  in  movement  over  the  network,  and  in  selec¬ 
tion  of  a  service  time  at  some  station  j  -  1,...M. 

(2)  Movement  over  the  network  is  governed  by  a  set  of  given  transi¬ 
tion  probabilities,  p^j . 

pij  “  p  C  customer  moves  to  station  j  J  he  has  Just  com¬ 
pleted  service  at  station  1  ] 

We  assume  tnatjEp  ^  -  1,  and  the  associated  Markov  chain 
is  irreducible. 

(3)  The  service  time  distribution  F(t;i,n)  at  station  i  is  the  same 
for  all  customers,  possibly  dependent  on  the  total  number  of 
customers  at  this  station,  n  =  1,2...N.  In  particular,  we 
assume: 

-u,  (n)t 

F(tji,n)  »  1  -  e 


For  clarity  consider  a  typical  network  as  illustrated  in  Figure  2a 
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Figure  2a  Figure  2b 

Closed  Queing  Network  and  Improper  Network 

Note  that  we  do  not  preclude  subloops  anywhere  in  the  network.  If  we  con¬ 
sider  station  1  as  being  in  a  main  loop,  note  that  stations  2,  3,  and  4, 
and  4,  5  form  subloops.  This  implies  that  any  customer  could  cycle  indefi¬ 
nitely  within  the  network  without  ever  returning  to  station  1;  however, 
from  assumption  (2)  this  event  has  probability  zero.  Figure  2b  represents 
an  Improper  network;  stations  4  and  5  and  6,  7  do  not  communicate  with  the 
rest  of  the  netwoik,  thereby  voicing  assumption  (2). 

We  defined  q^  in  Charcer  I;  they  nay  be  found  from 

<1  “  1 

M 

(3.2)  ™  ^ 

Note  that  if  they  were  normalized  by  using  (3.2)  and 
K 

L  q,  -  1 

i-1  ^ 

they  would  represent  the  steady-state  probabilities  of  finding  a  given 
customer  (N  •  1)  at  station  i,  of  the  Markov  chain. 

Note  also  that  the  absence  of  any  subloops  other  than  those  contain¬ 
ing  station  1  makes  the  solution  of  equations  (3.2)  almost  crivial;  this  is 


/ 
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caused  by  the  near-cri .v  gularity  of  the  set  of  equations. 

Using  the  sane  notation  as  in  Chapter  II,  the  time  average  steady- 
state  equations  are, 

<3*3)  M  M  M 

p(b) 4I '  lCni>o!b]  -  E  L  ^  Pjl  P(b(j,i))  iCn^lbO,!)] 

j-1  i-1 


We  note  that  these  equations  cover  all  of  the  possible  transitions  in  the 
imbedded  irreducible  Markov  chain  for  if  a  particular  center  j  does  not  con¬ 
nect  directly  to  center  i,  p^  -  0,  and  that  term  is  eliminated  from  the 
equations . 


Theorem  III-l:  The  solution  to  system  (3.3)  is  given  by, 


(3.4) 


Proof;  From  all  of  the  previous  assumptions  about  the  process  it  is  enough 
to  show  that  (3.4)  satisfies  (3.3). 

Define: 


,  .  K  n.(b)  n_(b) 

Y(b)  -  n  qt  /  q.  •L 

i-2  ^  1 


where  b  represents  the  usual  point  coordinates  of  .  From  this  definition, 

it  is  clear  that  (3.4)  is  equivalent  to, 

M  n,(b) 

P(b)  -  P(H,0,...0)  H  (p./p  )  -  Y(b) 

i*l  1  1 

Also,  from  physical  reasoning, 


.  1(b)  (^i) 


If  (3.4)  is  correct. 


r  K  n.  (b)-/ 

“i  Pji  n  (ym) 1  J  p  Y(b(j,i)) 

i*l  i  * 


For  j  -  1, 


P(b(l,i))  -  P(b)  yjy^ 


and 


\  hi  P(b)  Vyl  ■  p(b)  h  hi  yi 
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Therefore,  equations  (3.3)  reduce  to, 


K  H  H 

P(b)  £  nt  ikjXJlb]  -  P(b)C  £  (  Fli  Vi  +  S  )l[n^>o|b]  ] 

i-1  i-  J-  — 

H 

but  »±/q±  £  pj±  -  ^(qi  -  \) 

-h-h  hsh 

and  the  right  hand  side  has  been  reduced  to 
M 

P(b)  £  \i.  I[m>0|b] 
i-1  1 

so  relations  (3.3)  and  (3.4)  are  equivalent. 

Theorem  III-l  is  a  powerful  tool  because  the  forms  of  the  time-average 
results  of  Chapter  IX  can  be  used  here  With  suitable  modification. 


Let: 

0^  -  average  number  of  customers  served  at  center  i  per  unit  time. 


Then  obviously. 


0*5)  ^  "  (1  "  Di)^  where  (l  -  D^)  -  P[server  i  is  busy] 


Note  that 

e±  ? 


i.e.,  the  number  of  customers  served  per  unit  time  is  not  identical  at  each 
state  as  in  Chapter  II.  To  show  this,  (3.5)  can  be  expanded  so  that, 

•  0^  q^  1 . .  .M) 

In  Chapter  II,  -  qj  (i,j  -  1...M)  and  hence  0i  "6j  • 

But  in  our  general  network,  q^  +  qj 


and 
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or  the  normalized  service  rate  at  station  i  equals  the  normalized  arrival 
rate  as  we  would  expect. 

We  can  relate  all  of  the  output  rates  to  say, 


(3.5a)  » 


and  the  mean  number  of  customers  served  in  the  system  per  unit  time  is, 

M  M 

K  -  E  8*  •  81/q1  E  ^  . 


i-1 


Then, 


i-1 


(3.6)  P  [a  g^en  transition  is  out  of  state  i]  - 

■  %±/  ^ 

i-1 

We  see  that  in  the  case  of  a  cyclic  queue  where  qi  -  qj  (i,j  -  1...M), 
(3.6)  reduces  to, 

r  ,  1 

P  L  transition  is  out  of  state  i  J  -  ^ 


Before  we  investigate  the  mean  xiait,  it  will  be  necessary  to  find  the 
steady-state  probabilities,  IT  (b) ,  of  the  associated  Markov  chain,  and  show 
that  they  retain  the  properties  of  the  cyclic  queue. 


Theorem  III- 2:  The  Markov  chain  steady-stati  probabilities  are  given  by, 


%t  M  %(b)  >1 

(3.7)  17(b)  «l/fci[  H  s  lCn.>o|b] 

i-1  1  i-1  1 

We  recognize  (3.7)  as  the  same  form  as  (2.13),  where  the  general  network 
structure  is  incorporated  into  the  definition  of  Xj..  i.e.. 


Our  assumptions  here  are  the  same  as  those  of  Theorem  II- 1  and  hence  the 
are  the  probabilities  of  a  single  irreducible  Markov  chain.  There¬ 
fore  it  is  enough  to  show  that  (3.7)  solve® 


(3.8) 


jr(b)  *  Z  ff(b,a)  ff(a) 
a*A 


(beA) 


Equations  (3.8)  can  be  written  as. 


MM  M 

ff(b)  .  E^  2^  ff(b(i,j))  l[n.j>oib]  /  E  l[n.j>o|b] 
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If  (3.7)  is  true,  then  after  some  cancellation 

„  M  n  (b)  M 

*(b(i,j))  -  (l/Bw)  X,  n  X  *  X.  E  p,  l[n  X)jb] 

J  k=l  K  1  1=1  1  1 


Then, 

ff(b) 


N  M  M  m  a  (bj 

-  (1/^)  £  £  l/q  n  x  lc  U  CL  p.  .  l[n  >0 |b] 
i-1  >1  J  k=l  *  3  ^  ^  ^ 


M  a  (b) 


Now  interchange  the  order  of  summation  and, 


M 


it  M  a  (b)  M 

®(b)  -  (1/tefJ)  II X*  E(l/q,)n,  I[n,>o|b]  E  p  q, 
M  k-1  *  >1  J  J  J  i-1  «  1 


but 


ipij  «i'«j 


by  definition,  and  the  theorem  Is  proved. 


Thus,  the  Markov  chain  probabilities  also  retain  the  same  form  as  in 

N 

the  series  cyclic  queue.  We  should  note,  however,  that  cannot  be 
determined  by  using  formula  (2.12). 

4.  Customer-average  Wait  in  Queue 

Analogously  to  Section  5  of  Chapter  II,  define: 

-  P  [system  in  state  b  just  after  the  next  arrival  to 
station  J  ] 


Vb) 


Then, 


7b)  ■ 


M 

2  *(b(i,j))  H.  p,.  iCn.X) |b] 
1-1  1  3 


M 


PCnext  transition  is  an  arrival  to  j]  £  u.l[n.>o|b] 

i-1  1  1 

We  know  from  (3.6)  that, 

r  M 

P  L  next  transition  is  an  arrival  to  j  ]  ■  q  /  E  q 

3  i-1  ^ 


Therefor*,  from  (3.6)  and  (3.7) 
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(3.9) 


Vb> 


M  n^(b) 

n  4* 

k-i^ 


if  ttj  >i 


o 


otherwise 


Define  the  random  variable: 


»  number  at  station  1  just  after  an  arrival  at  1. 

Then, 


and  the  mean  wait  is  given  by, 


(3.11)  E(W±)  -  EOO/l^ 


Chapter  IV 

MISCELLANEOUS  EXTENSIONS 


1.  Approximations  to  Open  Systems 

Gordon  [3]  has  also  formulated  a  general  closed  network  model.  He  has 
left  the  solution  to  the  steady-state  equations  in  a  more  cumbersome  form 
than  (2.1)  and  he  has  not  shown  the  reduction  in  form  to  the  cyclic  queue 
case.  His  formulation  is  used  to  analyze  the  following  two  problems: 

a  -  Asymptotic  results  for  the  marginal  distribution  of  the  number  of 
customers  at  a  service  center  as  N  -*  »,  M  finite;  and  as  M  «, 

N  finite. 

b  -  Cyclic  queues  with  limited  storage  space  for  customers  between 
service  centers. 

His  results  on  the  first  of  these  problems  are  relevant  here.  He  has  shown 
that  as  N  becomes  unbounded  one  can  make  two  meaningful  observations: 

(1)  the  number  of  customers  at  the  slowest  service  center,  S,  also 
becomes  unbounded  and  hence  the  center  is  always  busy; 

(2)  the  marginal  probability  distribution  for  the  number  of  customers 

at  stage  i  (  >p.,  ) »  becomes  geometric  in  the  single  channel 

case.  That  is, 

JPOh)  -  P0ixini 

Suppose  we  treat  the  slowest  center  as  a  Poisson  input  stream  to  the  rest 
of  the  network.  Using  Jackson’s  definitions  from  Section  2,  Chapter  III 
we  get,  M 

rs  -  •‘s  '  ri  *  Pfci  rk  {  1  *  s  ) 
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1 
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It  can  easily  be  shown  that  T  reduces  to 

a. 


Hence, 


r  ■  n  ■ 


s  \ 


n. 


pfcj.)  -  pc1  yy'1  -  y1 


which  is  Gordon's  result.  Thus,  the  closed  network  system  is  asymptoti¬ 
cally  equivalent  to  an  open  network  system.  If  more  than  one  service  cen- 
ter  has  the  slowest  service  rate,  Gordon's  result  holds  only  for  the 
remaining  centers  with  faster  service  rates. 


2.  Customer-Dependent  Service  Rates 

For  a  general  network  structure  we  can  easily  handle  a  service  distri¬ 
bution  which  is  of  the  form 

-P.  (n)t 

F(tji,n)  =  l-o  1 

We  assume  that  the  internal  movement  probabilities  remain  fixed  with  respect 
to  the  number  of  customers  at  a  service  center.  Then,  it  is  easily  shown 
that, 


N-n-  (a)  M  n.  (a) 

P(a)  -  P(N,0,.#.0)  I!A  P,  G'-k+l)  H  q.  A 

k=l  ~  i=2 

:i,-(a)  N-n.  (a) 

n  n  ^i.(k)  o 

i*2  k»l  *  x 

where  an  upper  limit  of  zero  in  a  product  is  interoreted  as  unity.  We 

can  specialize  this  result  to,  , 

\kn.  if  l^SS. 

Pi0:)  -  S.1^  if  k 

where  ■  number  of  parallel  channels  at  service  center  1.  Letting  *  S 
and  Sj  “  1  (J  4  i)  we  get  the  same  result  as  (2.26),  i.e., 


P(N,0,,. 


if  n^a)  <  S 


P(a)  - 


n.  J 

"  *'n.  (a)-S  M  Jv(a) 
p(n, o, ,..o)  (1/S' s  )  nx  K 

lc»l  K 


if  ^(a)  i  S 
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3.  Comparison  of  a  Single  Customer  (N=l)  and  a  Two  Customer  QX"2)  System 
For  a  single  customer  system  there  is  no  interference  anywhere  in  the 
system.  The  steady-state  results  can  be  summarized  as  follows: 

M 

if  nt(a)  «  1 
i-1 

>Q  otherwise 


ir(a)  - 


/  M 

V  S<Ji 

i-1 


if  n-^a)  -  1 
otherwise 


\(a) 


\ 


0 


E(R  )  -  1 

Z(\)  -  l/\ 


if  n^(a)  =  1 


otherwise 


and  E(W  (i))  «  0. 


We  note  that  the  Markov  chain  probabilities  are  independent  of  the  service 


rates  whereas  the  time  average  probabilities  depend  upon  both  service 


rates  and  normalized  arrival  rates  (q^).  If  the  were  normalized -by 

K 

2  %  -  1  > 
i-1 

the  Markov  chain  probabilities  of  the  process  would  be  identical  to  the 


Markov  chain  probabilities  of  a  random  walk  through  the  network,  i.e.. 


*(a)  - 


0^ 


if  :ii(a)  -  1 
otherwise 


For  purposes  of  comparison  with  a  two -customer  system  the  most  mean- 

the  mean  wait  in 

q  — 9  w 

queue.  Omitting  the  details  we  get, 


ingful  parameter  that  shows  interference  is  E(Wq(i)) 
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E(WJ  -  ^(^i2  *  ?  X.X,)/  1  q,  4 

j&  J  i-1 

K(Wq(i»  -  q1  I,2/^ 


Lot  bo  tho  ratio  of 


2(W< ) 

^TIT) 


For  N  ■  1,  we  get  ■  «  #no  interference. 


For  N  -  2,  we  get. 


3^  -  2  +  (1/X. )  S  3^ 

1  jri 

«  2  +  (V*)  SI 

*  jri  3 


As  y £  gets  large,  increases  linearly.  One  can  increase  y^^  by  increasing 
the  service  rate  or  by  decreasing  the  probabilities  of  reaching  service 
center  i.  Thus,  for  e  center  with  a  fast  service  rate  and  small  probability 
of  being  reached  is  large  and  we  have  little  or  no  interference;  for  a 
center  with  a  slow  service  rate  which  can  be  reached  with  high  probability, 
decreases  and  we  have  more  interference.  Notice  that  if  Is  large  but 
finite  we  always  get  some  interference.  In  fact  for  N  ■  2, 

i(a)  .  if  -  2 

-  h2  Vyi  4 


The  probability  is  inversely  proportional  to  and  hence  is  small;  it  can 
be  neglected  if  is  large  enough. 


41 


As  we  Increase  N,  the  interference  terms  get  larger  and  it  is  not 
apparent  that  even  for  fast  service  centers  the  mean  delay  in  queue  will 
be  close  to  zero. 

4.  The  Marginal  Distribution  of  the  Number  of  Customers  at  Service  Center  i 
Reference  has  been  made  to  Gordon*  s  (3  ]  work  on  marginal  distributions 
of  the  number  of  customers  at  service  center  i.  He  has  concluded  that  not 
much  can  be  said  in  general  about  these  distributions  and  he  has  developed 
asymptotic  results  for  them.  We  can,  however,  prove  a  property  of  these 
distributions  that  will  be  of  value  in  one  of  the  optimization  problems  to 
be  considered  in  Chapter  V. 

Define: 

Pi(k;N)  ■  PCk  customers  at  service  center  1  when  there  are  N  in  the 
system  ] 

Theorem  IV-1:  Pi(k;N)  has  an  IFR  (increasing  failure  rate  distribution). 

Proof:  The  failure  rate  function  is  defined  as, 

N 

r.(kjN)  -  PiOcjN)/  E  p.( j;N) 

1  J-k 

It  is  necessary  to  show, 

(4.1)  r± (k;N)  *  r^k+ljN)  for  k  - 

where  N  is  arbitrary  . 

We  proceed  by  induction  on  N. 


N-l:  rj  (1;1)  ■  1  by  definition 

r^(0;l)  -  p^Ojl)  <  1  implying  ^(Ojl)  £  r^Cljl) 


Now  assume  r^(k;N)  ^  r^k+ljN)  for  k  ■=  1,....N-1 

and  we  will  show  (4.1)  for  N+l.  From  the  definition  of  r^(k;N),  (4.5) 


reduces  to 


p^CkjNj/p. (k+l;N)  ^1  +  (  S  ha.  H  u 

1  a^n-k)  k-1  j-k+1  acA-Cni-j) 


M  rv_(a)  N 

nA*  V  * 


^c(a) 


or 


k  N-k  N  i  N-i 
(4.2)  Pi(k;N)/pi(k+l;N)  *  1  +  hu)/  j^V  hij. 


where  is  defined  by  (2.2)  and  z9 


1.  We  need  to  show 


(4.3)  ,  M  1.+1  N+l  4  M  4.^ 

Pi(kjH*l)/pi(k*liN*l)  f  i  ♦  (x.k  z;J  X)/  S  V  1 


1,0U'  Pi(kjN+l)/Pi(k.l;N+l)  . 

-  Pi(k-l;N)/pi(kjN) 

But  we  have  assumed  the  result  is  true  for  N.  Therefore, 

k-1  N-k+1  N  j  N-J 

p.  (kjN+l)/pi(k+ljN+l)  *  1  +  (X.  Z,:_L  )/SX± 

d“k 


But, 


N  j  N-j  N+l  j  N-j+1 

S  li  ^w.  ■“  J  Xi  ^-i-i 

>k  i  >k+l 
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Therefore, 

k  K-k+1  M+l  j  N-j+1 

Pi&jN+D/p^Ck.X;!!^)  s  1  ♦  (X  Z,.  ,  )/  S  \ 

1  i  1  x  >k*l  1 


establishing  the  induction.  Hence  p^(k;N)  is  an  IFR  distribution. 


Chapter  V 

OPTIMIZATION  PROBLEMS 


1.  Introduction 

Managers  of  service  systems  are  concerned  with  more  than  an  analytic 
description  of  steady-state  operating  characteristics;  they  face  economic 
problems,  such  as  maximizing  output,  subject  to  resource  constraints.  For 
example,  service  rates  in  a  coal  mine  may  be  linearly  related  to  the  num¬ 
ber  of  workers  doing  a  specific  job;  given  a  limited  total  number  of 
workers  in  the  mine,  the  problem  is  to  allocate  them  to  the  work  stations 
in  order  to  maximize  output.  Or,  a  manager  of  an  engine  overhaul  facility 
is  interested  in  adding  parallel  production  lines  to  increase  output,  or  to 
reduce  the  probability  of  having  no  engines  in  service,  and  wishes  to  know 
if  the  benefits  obtained  will  offset  the  extra  cost. 

These  two  examples  offer  a  contrast  in  approaches  to  optimization 
problems.  The  former  is  more  or  less  a  continuous  decision  problem  in  the 
control  variables,  while  the  latter  is  a  matter  of  costing  and  comparing 
specific  alternatives  using  the  results  of  Chapter  III.  In  this  chapter 
we  shall  examine  the  continuous  decision  problems  in  order  to  see  if  we 
can  infer  some  general  properties  of  the  operating  parameters  of  such  sys¬ 
tems.  An  example  of  discrete  selection  can  also  be  found  in  Section  5. 

2.  Cost-Performance  Alternatives 

The  two  examples  of  optimization  problems  stated  above  provide  a  natu¬ 
ral  focus  for  two  major  classes  of  problems.  These  are: 


<♦5 


1  -  Allocation  of  resources  to  an  existing  queuing  network. 

2  -  Design  of  a  new  queuing  network  and/or  alteration  of  the  structure 

of  an  existing  network. 

In  both  classes  of  problems  the  decision  maker  is  usually  Interested  in 
optimizing  cost  or  performance,  or  in  evaluating  tradeoffs  between  cost  and 
performance.  Let  us  consider  some  possible  forms  for  these  problems. 

For  allocation  problems  we  can  identify  the  following  major  elements: 

1  -  Objective  function  -  minimum  cost,  maximum  production,  etc. 

2  -  Technology  -  the  necessary  work  stations  in  a  network  to  process 

the  customers,  the  arrangement  of  the  work  stations,  the  rules  that 
define  movement  in  the  network,  the  relationships  between  resource 
inputs  and  service  rates. 

3  -  Resources  -  labor,  machines,  capital,  equipment  that  can  change 

the  technology,  etc. 

A  typical  mathematical  form  for  such  a  problem  is. 

Max  F(n)  subject  to 
(V.l)  M 

£  K,  *L 
i-1  1 


where 


^  “  ( ^ » •••» 


and  *  r(K±) 

Here,  k^  is  the  amount  of  resource  (such  as  labor  or  capital)  allocated 
to  service  center  i,  L  is  the  maximum  amount  of  the  resource,  and  the 
service  rate  depends  upon  the  allocation  of  the  resource;  F(p  )  might  be 
production  rate,  or  cost  rate,  and  its  form  depends  upon  the  technology 
of  the  system. 
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We  sight  also  consider  the  possibility  that  the  technology  represented 
by  the  network  can  be  altered  by  changing  the  internal  movement  probabili¬ 
ties.  For  example,  suppose  that  revenue  is  generated  each  time  a  customer 
is  served  at  service  center  i  and  that  a  cost,  cjj  (per  hour  of  operation), 
is  associated  with  his  movement  to  service  center  j.  We  can  program  the 
Pij  by  the  following  problem: 

M 

Max  G(l-D  )  -  £  c .  .p,  *  subject  to 

(V.2)  *  j-1 


M 


Z 

j-1 


where  G  - 


c  1 


TJ.  .  *  0 
‘10 


revenue  per  customer 


The  first  term  in  the  objective  function  is  the  average  revenue  per  hour 
and  the  second  term  is  the  average  transportation  cost  per  hour.  Note  that 
the  p^j  appear  implicitly  in  the  first  term  in  the  defiuitlon  of  D^.  In 
solving  problem  (V.2)  one  must  be  sure  that  the  programmed  Pjji#  do  not 
violate  the  assumption  of  irreducibility  of  the  associated  Markov  chain; 
such  a  violation  could  occur  if  one  or  more  of  them  had  a  zero  value. 

Next,  consider  a  cyclic  queue  model  of  airline  maintenance  operation 
where  a  plane  is  served  at  two  maintenance  stations  and  then  goes  into 
flight.  (.Figure  3) 


SE fcVlC-C  | 


Pi  [<tHT 


Figure  3 

Airline  Maintenance  -  Cyclic  Queue 


A  plane  earns  $1  for  every  hour  in  service  and  it  costs  $  for  every  hour 
of  waiting  time  in  queue.  It  would  be  of  interest  to  describe  the  function 
of  net  revenue  versus  the  number  of  planes,  N,  in  the  system  in  order  to 
determine  the  marginal  cost  of  congestion.  On  every  cycle  through  the  sys¬ 
tem  the  net  revenue  is,  (expected  value) 

3  ‘ 

1-rS  E(W  (i)) 
i-1  q 

This  type  of  problem  is  a  typical  example  of  a  design  problem.  Another 
type  of  design  problem  would  be  the  measurement  of  increased  system  output 
by  increasing  the  number  of  service  channels  at  a  station  and  comparing 
the  cost  of  increased  service  to  the  value  of  extra  output.  See  [6]  and 
[7]  for  example. 

3.  Maximization  of  Production  Rate 

Let  us  reconsider  problem  (V.l)  as  applied  to  a  cyclic  queue  where  the 
service  rates  are  proportional  to  the  resource  and  the  objective  is  maximi¬ 
zation  of  production  rate,  i.e.. 

Max  F(n)  -  (1-D^)  j;  subject  to 

(V.la)  M 

2  4.  *L 

i-1  1 

li  *  0  for  all  i*l,...,M 
where  -  1  for  all  i , 

and  C  is  a  constant. 

The  problem  can  be  reformulated  as, 

M 

(5.1)  I-Iax  €(|i)  -  F(u)  -  «(  £  p.  -  L) 

i-1  1 

where  Of  is  the  well  known  Lagrangian  multiplier .  If  F(  tt)  was  a  concave 
function  the  solution  of  (5.1)  would  '  a  at  hand  for  the  condition  for  a 

-  0  i*=l,..,.M 


stationary  point. 
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Is  given  by, 

(5.2)  (l"Di)  -  ^  “  k-V  “  ^  SV3tlj  i>J  -  1,....H 

Concavity  of  F (|X  )  could  not  be  shown  because  of  the  difficulty  of  analyzing 
ratios  of  polynomials.  For  example,  consider  the  elements  of  the  Hessian 
matrix  of  F( H) : 

<5.3)  ,  ,  2 

^  S^/a^2  -  Var(L(i))Dt  .  (  E(L(i))  )>  .  E(L(i))D1 

(5.4)  |lj  a^/a^aii  .  CovarCLCi^Hj))^  .  E(L(i))E(L(j))D  -  E(L(j))Di 

♦(  E(LCj)HX)  S  n,(a)  nx„%ll) 

a«£(r. -0)  J  k 
a  i 

These  terms  have  proven  too  difficult  for  analysis  in  general  and  hence  we 
cannot  conclude  that  F(  pi)  is  or  is  not  concave.  However,  we  can  solve 
problem  (V.la)  without  requiring  concavity. 

Theorem  V-l;  The  optimal  allocation  of  resources  for  problem  (V.la)  is 

^  -  L/M  for  all 

Proof: 

We  state  the  obvious  fact  that  F(p.)  is  homogeneous  of  order  one. 
Therefore  the  solution  lies  in  the  plane, 

M 

S  u  *  L 

i*l  1 

Next  we  prove, 


Lemma  (5.1)  -  F(y)  is  concave  in  its  orthogonal  directions,  i.e., 

<  o 
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Proof:  From  equation  (5.3)  it  is  only  necessary  to  show, 

(5*5)  Var(L(i))  <  (  E(L(i)))2*  3(L(i)) 

2 

Define  K  *  coefficient  of  variation  of  the  distribution  of  L^. 
Since  E(L(i))  >  0  ,  (5.5)  reduces  to 

K2  <1  +  l/E(L(i)) 


By  Theorem  (IV-1)  the  distribution  of  is  IFR;  Barlow  and  Proschan 

have  proven  that  if  a  distribution  is  IFR, 

2 

K  ^  1  and  hence,  2 

K  <  1  +  l/E(L(i)) 


proving  the  Lemma. 

We  also  note  that  F(  p)  is  symmetric  with  respect  to  the  service 
center,  i.e.  If  p°  is  a  permutation  of  p,  then  F(p°)  ■  F(p) 

Now  let,  M 

CS-Cp|  E  p^  ■  L  }  -  set  of  all  vectors,  P,  in  the 
i*l  plane. 


Consider  some  p  C  G,  and  let 


°2  ■  Vl-V 


such  that  if 


P±  c  and  Pj  c  G2  ,  P±  *  p^  for  all  i,j 

Now  consider  some  other  vector  p°  €  G,  such  that 
Pi°  -  Pj_  +  c  for  all  p±  € 

P^°  "  "  nj_  c  for  all  p^  €  G2 

where  €>0  is  arbitrarily  small,  m,  i  0,  n.  i  0  , 
k  M  ii 

and  E  m.  -  1  -  S  n- 
i-1  1  i-k+1 

Because  the  solution  plane  cuts  the  space  of  p  symmetrically,  one  can  move 
to  any  vector  P°for  which  the  service  rates  are  more  out  of  balance  than 
in  p  ,  by  the  indicated  operation.  The  symmetry  of  F  with  respect  to  the 
service  centers  allows  us  to  consider  vectors  only  on  one  side  of  the 
balance  point.  The  directional  derivation  of  F  from  P  to  p°  is  given  by. 
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k  X 

3F/9ti  -  €  (  £  m.  SF/ott.  £  n,  ) 

i-1  1  x  i-k+1  1  1 

Let  n  ■  Min  and  u  -  Max  ^ 
if&L  3  1«3,,  ^ 

As  a  consequence  of  Lemma  (V.l),  if  ^  ^  ^ 

^F/a^  *  3F/a^# 


Then, 


or 


k  V. 

bF/Zv  <  €  (  3F/Sn  £  a,  -  ap/Su  £  n.  ) 
r  i-1  1  s  i-k+1  x 


3F/an  <  < (  ap/a^  -  aF/a^  ) 

I*  3 


But  ^  pg  by  previous  assumptions  implying 

aF/au  *  a?/a- 

*  S 

Therefore, 

SF/a(i  <  0  . 

Now  if  n  -  (L/X,..L/M)  then  for  every  vector  jx°  e  u, 

aF/dji  s  0  Which  implies  F(|i°)  <  F(L/M,.,,L/M) 

Hence,  production  rate  in  a  cyclic  queue  model  can  be  maximized  by  equaliz¬ 
ing  the  service  rates.  Without  much  difficulty,  we  will  show  that  this 
result  can  be  extended  to  a  more  general  class  of  networks. 


Corollary  (V-l) :  Given  a  network  for  which, 

for  all  i,j 

the  optimal  solution  to  problem  (V.la)  is, 

^  -  1/M  i»l, » • ,M 

Proof:  The  proof  of  Theorem  (V-l)  rests  on  two  major  characteristics  of 
cyclic  queues.  These  are: 

(1)  (l-J^)  H  -  e±  -  0  i-l,....M 

(2)  has  an  IFR  distribution. 


We  have  previously  shown  (Chapter  III)  that  if 
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“i  ■  v 

tt-^)  n  -  et  -  o  1=1,... .k 

and  that  has  an  IFR  distribution  for  any  network.  Therefore,  Theorem (V-1) 
is  valid  here. 

This  type  of  network  corresponds  to  one  in  which  there  is  completely 
random  internal  movement  such  that  each  service  center  is  equally  likely  to 
be  visited  by  a  customer. 

The  treatment  of  problem  (V.la)  for  a  network  where  the  are  arbi¬ 
trary  is  analytically  untractable  for  the  following  reasons: 

1  -  F(  n)  ■  (1-D^)  is  not  a  constant  for  all  1  »  1...M. 

2  -  F(  p.)  may  not  be  concave. 

3  -  F(  p)  is  not  symmetric  with  respect  to  i  except  In  the  special 

case  noted  in  Corollary  (V-1) . 

Let  us  suppose  that  the  production  rate  is  measured  at  a  single  service 
center,  i,  whose  service  rate  is  fixed;  our  problem  reduces  to  allocating 
the  resource  to  the  M-l  other  centers  in  order  to  maximize  (1-D^) 

Let  us  fix  our  attention  on  the  single-customer  network  (N  »  1) . 

Theorem  V-2:  For  a  single-customer  (N  ■  1)  closed  network  of  queues  and 
the  following  problem: 

Max  (1-D^)  ^  subject  to, 

S  U  *L, 

the  optimal  solution  is, 

-  L(  /o  /  £  /o, 

2  J  jri  J 


(5.6) 
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Proof;  Differentiating  the  Lagrangian  function, 

(1-D±)  H,  -  Qf(  S  p.  -  L) 

yields  (5.6)  as  the  stationary  point.  It  is  only  necessary  to  show  that 
this  point  is  a  maximum.  Omitting  the  details,  it  is  easily  shown  that  the 
principal  minors  of  the  determinant  of  the  Hessian  matrix,  of  (1-D^  , 

alternate  in  sign  and  hence  (5.6)  represents  an  optimal  solution. 

For  a  system  with  ar.  arbitrary  number  of  customers,  we  can  start  out 
with  (5.6)  as  a  solution  and  then  check  to  see  how  close  we  are  to  the 
stationary  point.  One  can  then  iterate  a  few  times  in  an  attempt  to  get 
closer  to  the  stationary  point.  It  has  been  our  experience  that  this  pro¬ 
cedure  is  computationally  feasible,  and  furthermore,  it  produces  a  near- 
optimal  solution. 

4.  The  Marginal  Cost  of  Congestion 

We  stated  earlier  the  problem  of  marginal  cost  of  congestion  in  an 

airlines  maintenance  system.  Net  revenue  is  given  by, 

3 

C  -  1  -  r  L  E(VJ  (i)) 
i-1  q 

and  we  wish  to  find  C  as  a  function  of  the  number  of  customers,  N.  We  have 
already  shown  in  Chapter  IV  that  for 

N  «  1,  E(W  (i))  ■  0  and  for 

q  2  2  M 

N  -  2,  E(Wq(i))  .  qjX.  /B,,  E  ?i 

Let  ■  1  <11  “  1/3 

X2  ■  2  q2  »  1/3 

X3  -  10  q3  -  1/3 

After  much  calculation,  for  N  -  3,  we  get. 
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N  C(N) 

1  0 

2  1  -  .89 

3  1  -  1.89 


C(M) 


N 

Figure  4 

Marginal  Cost  of  Congestion 

If  we  treat  N  as  a  continuous  variable,  the  cost  curve  has  the  form 
that  is  illustrated  in  Figure  4.  With  such  a  curve,  a  manager  can  decide 
how  many  customers  (planes)  can  be  handled  profitably  in  the  system.  If 
the  revenues  and  costs  are  marginal  values,  then  the  system  is  saturated 
at  the  value  of  N  for  which  C (N)  -  0  (Nil). 

5.  PCA  Airlines  -  A  Discrete  Selection  Problem 

PCA  Airlines  is  a  commuter  service  between  San  Francisco  and  Los 
Angeles.  Their  fleet  of  planes  consists  of  5  Starstream  Propjets;  four 
of  the  planes  run  the  regular  service  and  the  fifth  one  is  held  as  a 
spare  to  be  used  when  one  of  the  others  breaks  down.  PCA  has  heavy  compe¬ 
tition  on  its  route  and  whenever  they  do  not  have  four  available  planes, 
customers  are  lost  to  other  airlines.  Presently  the  planes  have  a  mean 
failure  time  of  150  hours  which  accounts  for  planned  services  as  well  as 
random  breakdowns.  The  planes  are  serviced  in  a  two  stage  service  station 


I 

'/ 
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where  in. the  first  stage  they  are  inspected,  diagnosed  and  cleaned  and  in 
the  second  stage  they  are  repaired  or  overhauled;  the  mean  service  time? 
are  2  and  10  hours  respectively.  Management  has  noticed  that  there  are 
various  times  when  they  do  not  have  four  available  planes  and  hence  there 
is  a  loss  of  revenue.  They  wish  to  consider  several  possible  improvements 
in  the  maintenance  system  in  order  to  cut  lost  revenues. 

The  present  system  is  illustrated  in  Figure  5. 


Figure  5 

Present  System  -  PCA  Airlines 


It  consists  of  a  3  station  cyclic  queue,  with  4  parallel  channels  at  the 
third  (or  operating)  station,  and  5  planes  in  the  system.  Assuming  that 
the  distributions  are  exponential  with  mean  service  rates, 

\  -  1/2 
v2  - 1  AO 
M3  -  1/150 

We  can  use  the  results  of  previous  chapters  to  compute  average  lost  revenue. 

Revenue  is  lost  whenever  there  are  fewer  than  4  planes  at  canter  three. 

Therefore,  (from  2.1  and  summing  to  obtain  the  marginal  distributions) 

P  (n3  -  0)  &  0 

P  (n3  ■  1)  »  .0017 

P  (n3  -  2)  -  .0125 

P  (n3  -  3)  -  .0623 

P  (n3  «3)  ■  .0763 


Hence  7.68  percent  of  the  tine  at  least  one  of  the  operating  channel*  Is 
idle. 


The  revenue  statistics  per  plane  are  as  follows: 
Capacity  -  100 

Avg.  Load  Factor 


Avg.  Length  of  Flight 
Avg.  Fare 

Annual  Flying  Hours  per  Year 
Avg.  Annual  revenue  per  plane 

Avg.  revenue  lost  per  year  > 
2(.0125)  +  3 (.0017.'  +  4(0)  ] 
Total  avg.  revenue  per  year 


passenger* 

-  .90 

»■  1  hour 

-  $12.00  per  flight 

-  4,500 


$4.85  x  106  l  l (.0623)  + 

-  $447,500 

<=  4  ($4.85  x  106)  -  447,500 

-  $18,95 >,!  00 


100  (.90)  $12  x  4,500 
$4.85  million 


The  lost  revenue  represents  2.3  percent  of  total  revenue* 

PCA  is  considering  installing  a  new  maintenance  facility  that  will 
improve  the  breakdown  rate  of  the  planes  but  will  require  the  same  average 
service  times.  The  new  facility  will  incr^se  the  mean  time  between 
failures  to  200  hours.  Recalculating  the  measures  of  Interest  ve  get 

p  (n3  £  3)  -  .0408 

and 

Avg.  revenue  lost  per  year  ■  $202,000 
Hence,  if  the  annual  cost  of  the  new  facility  is  less  than  $245,500,  it 
pays  to  Install  it.  We  note  here,  that  in  these  optimisation  problems 
we  are  not  directly  concerned  with  flow  rate  but  we  are  concerned  with 
reducing  the  probability  of  not  having  enough  planes  to  fly.  There  is 
also  the  possibility  that  with  the  new  system  the  servicing  technology 
can  change.  With  a  little  more  time  at  the  first  station  there  is  a  0.4 
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probability  that  a  plane  can  go  directly  to  the  flight  line  and  bypass  the 
second  stage.  This  structure  ia  illustrated  in  Figure  6. 


Figure  6 

Modified  System  -  PCA  Airlines 

Assume  that  the  new  service  rates  are  ^ 

^  -  1/4  Y1  -  1/4 

^2  ■  lAO  ?2  -  1/6 

“  1/200  y  «  1/200 

Recalculating  the  results,  we  get 

P  (n3  £2)  -  .0273 

Avg.  revenue  lost  per  year  -  $149,000 

Hence,  if  the  new  facility  and  new  technology  costs  less  than  $298,500,  it 
pays  to  install  it.  One  could  go  on  and  compute  the  effects  of  many' other 
proposals;  as  long  as  we  have  closed  form  expressions  the  process  could  be 
computerized  for  larger  problems. 

It  might  be  of  interest  to  note  the  effects  of  having  5  planes  in  the 
system  rather  than  4.  Under  the  last  proposal,  there  is  a  probability  of 
.81  of  having  all  5  planes  available.  This  means  that  81  percent  of  the 
time  a  plane  is  idle  and  not  generating  any  revenue.  Consider  the  same 
system  with  just  4  planes. 

P  (n3  *  3)  -  .1825 
and 


Avg.  revenue  lost  per  year  •  $990,000. 
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The  lost  revenue  is  ebout  twice  the  annual  capital  cost  of  one  of  these 
planes  and  therefore  the  extra  plane  is  economically  justified;  note,  that 
it  may  also  be  justified  purely  on  a  service  level  basis  because  an  18  per¬ 
cent  chance  of  a  cancelled  flight  may  not  be  tolerable  to  the  public. 
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